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Foreword:  The  objective  of  this  effort  is  to  develop  guidance  and  control  algorithms  for  coordination  of  multiple  vehicles  in 
uncertain  adversarial  environments  with  particular  emphasis  on  the  use  of  vision-based  sensors.  This  broad  objective  is  related  to 
various  mission  scenarios  that  a  system  of  autonomous  vehicles  might  need  to  accomplish.  Examples  include  intelligent  surveillance 
and  reconnaissance  (ISR),  ground  target  suppression,  sequential  autolanding,  search  and  rescue,  etc. 

Statement  of  the  Problem:  We  consider  the  problem  of  steering  a  fleet  of  UAVs,  equipped  with  commercial  off-the-shelf  autopilots 
and  monocular  cameras  with  complementary  visual  capabilities  (resolution),  along  the  given  paths  (path  following)  under  strict 
spatial  and/or  temporal  constraints  (collision-free,  simultaneous  arriving,  etc.).  The  UAV  with  high  resolution  fixed  camera  is  used  to 
find  and  recognize  the  ground  target  moving  with  time-varying  velocity.  After  the  target  is  recognized,  the  UAV  with  low  resolution 
gimbaled  camera  switches  to  tracking  mode,  and  maintains  a  desired  ground  distance  from  the  moving  target,  while  the  high 
resolution  UAV  lowers  down  the  altitude  and  takes  video  of  the  target,  still  coordinating  with  the  tracking  UAV. 

Towards  this  objective,  our  initial  approach  during  the  first  year  of  the  grant  was  to  develop  basic  fundamental  theory  for 
coordination  of  multi-vehicle  systems  in  the  presence  of  spatial  constraints  with  guaranteed  performance  bounds,  assuming  that  the 
inter-vehicle  communication  network  topology  is  fixed  in  time.  In  particular,  we  have  demonstrated  how  the  LI  adaptive  control 
theory  can  be  used  for  augmentation  of  the  off-the-shelf  autopilots  to  enable  time-critical  coordination  within  spatial  constraints  - 
missions  that  these  autopilots  were  not  originally  designed  to  perform.  During  the  second  year  we  extended  the  theoretical  framework 
to  allow  for  time-varying  communication  network  topology,  including  network  failures  and  delays.  Leveraging  from  our  basic 
research  performed  under  AFOSR  grant,  we  proved  that  the  LI  adaptive  control  theory  can  be  used  to  ensure  uniform  performance 
bounds  and  accurate  path  following  for  a  fleet  of  vehicles  in  the  presence  of  time-varying  inter-vehicle  communication  network 
topology.  During  the  second  year,  we  also  explored  reactive  vision-based  obstacle  avoidance  algorithms  for  vehicles  following  a 
given  path.  During  the  third  year,  we  developed  the  vision-based  ground  target  tracking  and  motion  estimation  algorithm  using  a 
single  UAV  equipped  with  a  gimbaled  camera.  The  estimator  for  target  position  and  velocity  is  a  fast  estimator  and  has  guaranteed 
estimation  error  bound,  which  makes  it  possible  to  use  the  target  image  (vision)  as  feedback  and  reduce  the  dependence  on  GPS.  The 
accurate  estimation  of  the  target  motion  also  allows  for  extension  of  the  previously  designed  tracking  algorithm  from  the  case  of 
static  target  to  the  case  of  moving  target  with  time -varying  velocity. 

Our  next  step  will  be  to  flight  test  these  algorithms  jointly  with  NPS,  using  their  small  UAVs,  leveraging  additional  sources  of 
funding  for  that  (e.g.  a  joint  grant  with  NPS  from  ONR  under  6.2  portfolio). 


Summary  of  the  Main  Results:  We  develop  verifiable  robust  adaptive  control  algorithms  that  can  compensate  for  rapidly  varying 
uncertainties  without  losing  robustness.  The  architectures  of  LI  adaptive  control  theory  allow  for  a  priori  quantification  of  the 
performance  bounds  and  analytical  computation  of  robustness/stability  margins.  These  architectures  have  uniformly  bounded 
transient  performance  for  systems  both  signals,  input  and  output,  simultaneously. 

In  collaboration  with  I.  Kaminer  from  NPS,  we  have  demonstrated: 

1.  Augmentation  of  the  off-the-shelf  autopilots  to  enable  accurate  path  following  and,  further,  time-critical  coordination  with 
aggressive  3D  path  following  of  multiple  UAVs  subject  to  spatial  constraints  in  the  presence  of  time-varying  inter-vehicle 
communication  network  topology  -  missions  that  these  autopilots  were  not  originally  designed  to  perform, 

2.  Target  motion  estimation  with  estimation  error  that  can  be  rendered  arbitrarily  small  -  the  key  step  towards  enabling  vision-based 
target  tracking,  motion  estimation,  and  accurate  path  following. 

3.  Vision-based  target  tracking  using  LI  adaptation  in  both  loops  for  estimation  and  feedback  to  enable  accurate  tracking  of  moving 
target  with  time-varying  velocity. 

These  architectures  are  being  flight  tested  by  I.  Kaminer  in  TNT  exercises  at  Camp  Roberts,  CA,  supported  by  USSOCOM.  Further, 
there  is  a  transition  effort  at  place  via  ONR  funding. 

Memo:  We  have  presented  some  of  our  preliminary  results  in  ARLs  in  Picatinny  Arsenal  and  Aberdeen  Proving  Grounds. 


Accomplishments 

•  Augmentation  of  existing  autopilots  for  coordinated  path  following  of  multiple  UAVs  over  time  varying  communication 
networks  subject  to  spatial  and  temporal  constraints,  flight  tested  by  I.  Kaminer  from  NPS,  in  Camp  Roberts,  CA,  in  February 
of 2007. 

•  Fast  adaptive  motion  estimation  and  vision-based  target  tracking  using  single  UAV  with  gimbaled  camera. 

•  Coordination  of  two  UAVs,  equipped  with  monocular  cameras,  for  tracking  a  moving  target  with  time-varying  velocity  (to  be 
flight  tested  in  October  2009  by  NPS,  leveraging  additional  sources  of  funding  for  that,  e.g.  ONR). 

•  Visiting  Army  Labs  in  Aberdeen  Proving  Grounds,  MD,  and  Picatinny  Arsenal,  NJ,  for  opportunities  of  transitioning  the 
technology. 


Collaborations  and  Leveraged  Funding:  We  have  developed  collaboration  with  Prof.  I.  Kaminer  from  NPS  under  joint  ONR 
grants.  I.  Kaminer  is  funded  by  USSOCOM  (US  Special  Ops  Command)  SORSE  (Special  Operations  Research  and  Support 
Element).  We  also  have  a  joint  grant  with  Isaac  Kaminer  from  NASA  under  the  NRA  program  on  flight  test  validation  of  metrics 
driven  adaptive  control.  Currently  we  are  also  funded  by  ONR  to  develop  a  flight  test  program,  which  would  use  the  theoretical 
solutions  developed  under  this  grant.  There  is  further  interest  from  ONR  in  supporting  these  solutions  from  their  6.2  funding  portfolio 
with  an  objective  of  transitioning  it  into  Navy  technology. 

Technology  Transfer:  As  mentioned  above,  these  algorithms  have  been  flight  tested  on  I.  Kaminer’s  testbeds  from  NPS,  which  is  a 
governmental  lab.  These  are  being  further  transitioned  to  USSOCOM  (US  Special  Ops  Command)  by  him  on  a  quarterly  basis  during 
the  TNT  exercises  in  Camp  Roberts,  CA.  I.  Kaminer’s  contact  is  kammer@nps.edu,  (831)  656-3459.  He  can  provide  further  details 
on  this.  Other  technology  transfers  of  basic  fundamental  research  include  WP  AFRL/Boeing  CerTA  FCS  CPI  program  (X-48B), 
NASA  IRAC  program  (GTM  AirSTAR)  and  Raytheon  Co.  NASA  Dryden  is  planning  to  integrate  the  methodology  in  F-18. 
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